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the rescurces at its disposal, this research examines +i 
streams' costs and benefits. toll MgEECOSt-beneri 
analysis techniques this research investigates pcrential 
tradecffs available to Navy policymakers as a result o 


humar. capital training investment within conventional and 


integrated perscnnel systems. Pindings suggest that an 
integrated personnel system enhances technical skill 
develcrment, personnel retention and job performance at 


decreas=d cost relative to a conventional personnel system. 
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I. INTRODUCTION 


A. MANPCWES PERSONNEL TRAINING PROBLEM 


Operating ina complex and dynamic environment where 
variables such as population demographics, increasing tech- 
nological cemplexity cf new weapons systems, and labor 
market ccmpetition interact, the Navy strives to sus-ain its 
manpcwer requirements. And, with ths reenactment of the 
all-volunteer force, [Ref. 1], the cost of military manpower 
has increased sharply -- partly as a result of lessening 
Military-civilian differences. Additionally, advances in 
technology have transformed the occupaticnal needs of the 
services. 

th few excepticns, the military has rarely be¢n immune 
to fluctuations in the economy; recently, for example, an 
increased demand for specialists and technicians has accel- 
erated ccst increases for training the multitude cf junior 
personnel who enter the services with liccle or no developed 
Skills. Such cost increases reflect sizeable investments in 


higniy valued skill development in an environment where 


Beresonnel are not centracted for life. As 2 competitor i 
the labor market the Navy must pay a significant price to 
retain skilled rerscnnel ard thus, gain some additicnal 


return on its earlier human capital training investments. 

Essentially, manpower requirements are a function of the 

kinds and numbers of skilled pecple needed in the service 
and the pecple within the total population available to 
serve. If only a few members of the populaticn whe are 

Excdlabie tc join the military have the requisite skills 
de 


then, selection and training of o 


(D 
14 


Sons With >ne prrerenss 


to learn the skills is necessary. 





Given the military's dependence on hardware and complex 
technological systems, a conceptual model exists chat is 
applicable as a tool fer integrating man-hardware cr man- 
machine principles relative to manpower selection and 
Frain!ng. Quite simply, man is an crganism capable of 
Processing information; thus, man is also an "intelligent" 
organism capable of lcng-term memory/recall of past events. 
Long-term memory is a function of: (1) sensation, (2) 
percepticn, (3) short-term memory, (4) decision-making and 
(5) motcr responses. Man, aS a biological organism, is 
susceptikle to environmental, physical and psychclogical 
stress. 

A machine is anassemblage of parts that transmit 
forces, motion and energy one to another in a predetermined 
manner; an instrument, a mechanism built of inert 
Materialsyresources by man, to transmit or modify the appli- 
@atiloOn Of pcwerg, force or motion. Machines are susceptible 
to envircnmental and physical stress. 

A man-machine interface implies chat a medium exists for 
combining man with machine to produce some optimum output or 
product. The term "manpower" implies that personnel whc are 
wn ladle tc perform in concert with machines are appropri- 


acely -zained to work with equipment/hardware of specific 


14) 


design that has been built with most, if not all, of man's 
corporeal characteristics in mind. 

A significant implicaticn of the above man-machine model 
is that werea hardware/machine system designed such that a 
large segmert of the population could operate it with near 
optimum results then, fewer funds would need to be allccated 
for the selection and training of required personnel. 

In summary, manpower personnel selection and training is 
ENMAUDnCticn cf the purpose, cbjectives and goals fer which 
hardware systems are acquired within “he military. Unless 

O 


Mie” hardware system is built with a capacity for operation 


10 





and/or mcnitoring in the complete absence of man, which is 
seldcm if ever the case, then, the equipment/mechanism as 
well as the selection and training process, shculd be 
develcped and censtructed with its human counterpart in 


mind. 


PB. CCNVENTIONAL PERSCNNEL SYSTEM 


The conventional personnel system is driven by an annual 
Mrlux of large numbers of unskilled, young people. In an 
uncertain manner thess large numbers of recruits are in the 
military because an external threat (such as a new Soviet 
capability) has been perceived; a threat that is to be 
countered via armed services! missions and objectives. 
Expensive hardware procurements are generated by the same 
perceived threats. In some cptimum way “hese large numbers 
cf unskilled pecple must be matched to the hardware to 
fulfill the job/task requirements within weapons systems. 
Meee hin She military, taining LS =hs vehicle by which the 
unskilled recruits are prepared co become more ccmpatible 
with the ships, tanks, micca re Control and launch 
systems as well as a host of other hardware or machine 
systems. Tradırzenally, era g expenses have been 


incurred in the Navy as a result of specialized training. 


There are three basic types of specialized training: (1) 
meecncol cr initial skill training; 2) e school er skill 
Beogression training; and (3) peschool or “func=icnal 


Exaljning. 


M ScuooTE-rajntjg is provided primarily to recent gradu- 
d 


n 
personnel 


ct 


O 
aces fzcm recruit training although some enliste 
who have nc? previously been to A-school may go to A-school 
from fleet assignment. A-school training provides the kasic 
technical knowledge and skills required to prepare fer entry 


level cr perfcrmance and further specialized training. 
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Prior tc receiving rating-specific training, students may 
take preparatory courses which teach core material ccmmcn to 
two cr mere initial skill courses. For example, the Basic 
Flectricity and Electronics (BF&E) Preparatory course ccvers 
subjects common to many ratings, including the Electrician's 
Mata (EM), Communications Technician-Maintenance (CTM), 
Wii ctronics Technician (ET), Aviation Electronics Technician 
fry, and Fire Contrcl Technician (FT) ratings. Students 
destined for these ratings attend BE&E schocl before 
Beceiving any. initial skill training for «heir particular 
Rating. 

There is an initial skill or A-school course for almost 
le ratangs. Currently, there are A-school courses for 
Boproximately 82 ratings. A sailor usually attends an 
A-school directly after boot camp and upon completion is 
Eonsidered a "striker" in the rating. This is the main or 
conventional training path leading to petty officer status 
(E4 and atcve) ina rating. 

A C-schcol or skill progression training, provides the 
advanced kncwledge, skills and techniques required tc fill a 
particular billet. C-schools are mors specialized in nature 
than A-schools. For example, an alectronics C-schocl could 
Bin an ET on a particular piece of equipment or system, 
such as, a specificradio recsiver. A perscn usually 
@erends C-school early in their career; For =xample, as in 
fest aviaticn ratings, ones way o go is D Dight after 
finishing A-school. Another way is for the Navy to 
quarantse a person skill progression =raining as a reenlist- 
ment incentive. In most cases this implies attending 
C-schcol tefere the end of the fifth year of service. 

F-coursss are of short duration and are generally opera- 
tional in nature. In some cases F-school, or func ioral 
Senocl training, is team training for fleet personnel who 


Lsbmalily are on board ship or are enroute to sea duty. In 
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other cases it is individual training such as refresher, 


cperatcr, maintenance or technical training. 


C. ALTERNATIVE PERSCNNEL SYSTEM 


A recent alternative to the conventionai perscnnel 
system described above is the Enlisted Perscnnel 
Individualized Career System (EPICS). EPICS is a career 
enhancement personnel system currently undergoing test and 
ENuacicn that purperts to: (1) reduce attrition; and (2) 
achieve cost-effectiveness through the use of "deferred" 
shore-based trainina. EPICS is designed tO provade 
apprentice sailcrs  cn-the-job experience complemented by 
job-rperfcrmance-aids (JPA's) and self-paced instructional 
materials. After the EPICS sailor has adapted to shiptoard 
life, JPA's and expertable shipboard instructional modules 
are further employed to ensure satisfactory job performance 
consonant with the individual's level of skill acquisition. 
Two shore-based training experiences are currently being 
cífered +hrcughout a four year enlistment if an EPICS sailor 
has demonstrated an interest and abilixy to benefit from 
Shors-bascd technical training. Thus, technical progress, 
shipbcard adjustment and educational opportunities are inte- 
grated into a personalized career path. 

In rany respects EPICS is an embellished version of 
eurent on-the-job training (OJT) paths for rating attain- 
ment. Scme ratings in the Navy are earned only via OJT and 
many "strikers" become so designated as a result cf OJT when 
A-school is not available. A major distincticn between 
EPICS and traditional Navy OJT is that EPICS applies these 
training techniques to sophisticated tachnical ratings when, 
historically, traditional Navy OJT has been geared =o less 
EESchnical ratings. For example, Boatswain's Mate (BM) is a 


non-technical rating that is achieved only via OJT whereas 





RS contro! Pechnician (FT), a more modern and techrical 
rating, is usually achieved via formal school training. The 
FT's are the rating for EPICS test and evaluation currently 
being ccrducted by the Navy Personnel Research and 
Develcrpmert Center (NEBDC). 


D. CONVENTIONAL VS. ALTERNATIVE PERSONNEL SYSTEM 


Scme principal differences between EPICS and the conven- 
tional perscnnel system are: 

1. EPICS seeks to defer large investments in training 
until the uncertainty concerning expected paycffs (ccn*inued 
availability of recipient) can be reduced. Conventional 
training, however, takes large numbers cf rewly enlisted 
service members directly into a formal technical training 
envircnment immediately upon completion cf basic training -- 
before much of any expected attrition can occur. 

E EPICS gperscnnel are trained in accordance with the 
actual jc requirements commensurate to tasks assigned 
Hmpong a first enlistmen- period. nr tos initial skill and 
preparatcry levels, ccnventional training is broad-based and 
theoretical in nature. Spec fre ski lis requited for equip- 
nent and/cr systems are caught at the advanced or C-schcol 
Uus] and possibly at the P-school level; sometimes pricr to 
the first sea assignment. 

EL SUTGS employs Ship-board on-the-job  *zaining/job- 
perfcrmance- aid (OJT/JPA) techniques in smaller student- 
Mmstructcr ratios fcr job/skill familiarization during an 
initial sea assignment. Also, EPICS training is clustered 
Ly 
administered until individual *rairees demonstrate 


| 


evels; training for subsequent levels is se (ele 


E 


competence (and continued presence) at +he rsvious skil 
level. Porex pl S; i Tai ning tor skill level III does not 


commence until skill level II is successfully mastered. 
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ec a 


Training in the conventional system utilizes a mixture of 
clf-paced programmed or computer managed instructior .supsr- 
vised by learning center instructors (LCI's) and group-paced 
Ns +truc=:1ion taught by a lecturing, classroom instructor. In 
Beth forms cf training the student to instructor ratios are 
quite large. Further, each student may be going eventually 


to one of several different ratings. 


ERRO SCCPE OF THESIS 


This study is an evaluation of whether the conventional 
perscnnel career path utilized by the Navy yields optinal 
returns in terms of sufficient numbers of qualified, skilled 
personnel relative to Navy investments in perscnnel 
training. Bysu gang human capital theory, a billet cost 
mode1, net present value, and certain general linear model 
derivaticns (stepwise discriminant analysis, discriminant 
analysis, regression, and multivariate analysis of variance) 
the costs and benefits were estimated and evaluated for 
these alternative career paths: (1) BABES. SEOANE) -PT 
meng, and (2) conventional, formal, specialized training 
eee the FT rating. 

For the purposes of this study benefits are defined 
relative to their effect on the fundamental objectives of 
poalning. Costs are defined relative to respective 
cpportunity costs or benefits foregone, as a result of not 
Mealizing 1imited resources in the optimal of the alterna- 
tive methcds when tke resources are instead utilized ina 
Seecific activity. The foregone benefits ale thus defined 
relative tc their potential effect on “he fundamental 
objectivss cf training. Only those costs that varied among 
the two career paths for similar events/benefits were 


examined. 
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1. Human Capital Theory/Model 


= 


The human carital model utilized in “his study was 
originally developed to estimate the economic returns for 
college attendance and other formal education [Ref. 2], but 
i- is generally applicable to other human investments such 
as on-the-job training, health and migration. The model is 
useful for analyzing the effectiveness and interrelaticn- 
ships between Navy pclicy revisions, career personnel force 
structure and career force training. 

The human capital model addresses three general 
aspects of training investments that are germane to Navy 
licy; the amcunt cf training investments, the type of 
Era: ning provided and the timing of training. Indsvroua2je 
and firms in the private sector will only invest in training 
if the disccunted present value of the returns exceeds the 
costs of investments. Heuristic economic arguments suggest 
that the Navy is investing in training far beyond “this 
point, even after the value of training as an accession «col 
is taken into account [Ref. 3}. 

The theory cf human capital distinguishes between 
myo rasic types of training, general and specific. For 
example, general training is that which is of value to many 
crganizaticns including the Navy. Ta Sealey 4. Of course, 
ee raining is composed of a certain proportion of general 
and specific elements. The distinction between general and 
Specific training is important in assessing the value of 
training to an individual (in terms of potential ccmpensa- 
tion) bcth inside and outside the Navy. Thus, the theory 
may also be useful in coordinating Navy compensation and 
maining policies. 

Since optimal training investments are determined by 
the disccunted present value of costs and benefits, “he 


Ang Cr those costs and returns are crucial. In general, 
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this implies that the longer the delay between tra 
use of training, the lower the net value of the investment. 
Related implications involving decisions on “he optimal 
Eni ro Cf training also exist for such Navy pcliciss as 
sea/shore rotation and length of anlistment/reenlistment 
poeutracts. 

À critical aspect of the investment decision is the 
way in which ccsts and benefits are measured. The costs of 
education or training include not only direct costs such as 
books, teachers and supplies but also indirect ccsts of 

Zalning. Mesoni rect costs, fOr example, oppcrtunity 
Sosts, represent the foregone preductivity of personnel 
during training and usually constitutes the major perticn of 
manning ccsts. Once opportunity costs are recognized, 
other Navy policy implications become relevant. FOr 
example, it is expensive to rotate a skilled “echnician tc a 
Eme=ze billet or to provide additional training to someone 
who is already trained in a valuable skill. As individuals 
accumulate human capital, the value of their time becomes 
much more valuable during a Decaining periods Thus, 
BEESrtunity costs and not direct costs of training may 
provide the focus for determining the optinal amount of 
Gaining. Ignorance or gross urderestimations of the 
Peencecmic costs of policy changes in training may contribute 
to military overinvestment in training. 


Althcugh the analogy between human and physical 


Capital provides many insights into the nature Oe 
individuals' decisions, the analogy should not te pursued 
Boo far. Human capital has a number of special properties 


that make i- unique amcng the assets an individual can buy. 
Contrary to other assets in most developed nations, human 
capital cannot te scld. The owners of human capital are 
Exuextricably tied tc their investment. An individual may 


Tent out this investment to employers but, they may not sell 


iy 





it in the way a firm might sell a machine it no Ilenger 
needed. Human capital alsc depreciates in a rather unusual 
manner. It is totally lost upon the death of its owner, and 
this makes the investment rather risky. Finally, the acqui- 
sition of human capital takes substantial time; the irrever- 
sibility of time makes this process of human capital 
investment all the more risky. Hence, there are a number of 
reasons tc be cauticus in applying the results of capital 
Ensory to the study of the acquisition of human capital. 
Nevertheless, the human capital theory can be useful as an 
evaluative tool for considering the merits of Navy policies 
such as using training as a recruitment incentive, 3/3 sea/ 
Ensre retaticn, integration of training, compensation and 


contract lengths as well as other relevant issues. 
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II. COST ANALYSIS 


A.  NERDC CCST ANALYSIS 


A report entitled "The NPRDC Enlisted Perscnnel 
Individualized Career System (EPICS) and Conventional 
Personnel System (CPS): Preliminary Comparison of Trainin 
Eme Anrc:llary Costs" [Ref. 4), estimated and compared the 
formal training and ancillary support costs required to 
qualify fire control technicians to operate and maintain the 
NATO SeasSparrow Surface Missile System (NSSMS) using EPICS 
and ccnventional perscnnel system (CPS) paths. This most 
recent 2ffort is but cne of several documents that have been 
released frcm NPRDC in an attempt to constructively evaluate 
an “integrated personnel system approach relative to the 


traditional, conventional Navy personnel system concept. 


1. Assumpticas 


Eecause EPICS research, development, implementation 
ama evaluation is so recent, significant data remains 
unavailakle. Nevertheiass, NPRDC reports have been 
produced. As such, ccsts/benefits analysis can be attempted 
utilizing various assumptions and definitions relsvant to 
available data fer ccmparison of conventional and integrated 
personnel systems. 

mncaMEMegrdatchian (1983) [ Ref. 4], and earlier 
Beports cn EPICS/CES comparisons, were conducted w 
assumptions relevant to economic life estimates, formal 
training cost components, and curricula development ccsts. 
In general, it was assumed that for the data known, and 


available, that such data was known with certainty. 


ies, 





Economic life is defined as the time period during 
which the «specific alternatives or alternative ccmporents 
provide a benefit or incur a cost. The duration of economic 
life is influenced ard limited by specific factors such as: 
NE pissicn life, 2) physical life and 3) technical life. 
Mission life is the time period over which a need for the 
asset (s) is anticipated; physical life is the time period 
over which the asset(s) may be expected to las- physically: 
and, technclogical life is the time period before otsclence 
would dictate replacement of the =xisting asset(s). Given 
these parameters, the task of evaluating *he cost/benefits 
of EPICS and CPS was further complicated by the analysis 
variables themselves; each of which had to be considered in 
terms of economic life and the resulting cost stream. 

In reference tc economic lif2 five assumptions were 
made; 1) EPICS and CPS had én identical perpetual economic 
mere, 2) school curricula, training modules,  JPàs, and 
administrative support materials were amortized over a life 
Cf ten years. These items had a physical life of five years 
requiring, cne replacement during the ten years of economic 
life acccmolished through maintenance; 3) maintenance cost 
percentaces for curricula, modules, JPAs, and support 
Materials were one percent for the first three years, five 
cent for the following three years, and one percent for 
de final fcurt years; 4) training horizon was taken as four 
years for training 200 FTMs and ten years for training 500 
FTMs; and 5) administrative support cost was computed for 
tne initial year of impiementation. The net presen: value 
was ccmputed throughcut this and other NPRDC reports using a 
ten percent discount rate. Economic life year and mainte- 
nance cost percentage estimates presented in the NPRDC 
report were developed through discussion with experienced 
Navy instructional technologists and Nato Seasparrow Missile 
System (NSSMS) data systems developers [Ref. 4]. 
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Fcrmal training cost assumptions were as follows: 
(1) Formal training costs for EPICS and CPS were assumed to 
be equal on a per week per student graduate basis (Ref. 5]. 
This was based on twc subparameters: (a) school less data 
were inccrplete at the time of the April, 1983 study when 
all cf the EPICS cohcrt had not entered equipment technician 
training (ETT) and system technician training (SIT), and (b) 
EPICS schcol training used (and still does use) the same 


facilities as CPS schools. 


foe At the time of the Megrditichian study [Ref. 4], the 
Barziculum for the NSSMS "C" school included 23 weeks for 
training in the fire control systems (FCSs) and ten weeks 
for training in guided missile launching systems (GMLSs). 
However, the NSSMS "C" school curriculum requirements were 
in a revision process that would combine the  FCS/GMLS 
@aericula into one, ende nus, would encompass 26 weeks of 
Pedi ning. This change permitted fair comparison of NSSMS 
Beeecchool and EPICS SIT, both of which include training in 
FCSs and GMLSs. 


(3 The training parity hcrizon was hyvothesized as three 
years, at which time both EPICS and CPS students would have 
received basic and system training reguired for NEC qualifi- 


Secticn. 


(4) CPS students wculd be NEC-qualified after they had 
successfully completed BEBE school, FT "A" school (phases 1 
EMO 2), and NSSMS 'C' school (combined). EPICS students 
would be NEC-qualified after they had successfully ccmrleted 
En STT and ETT. It should be noted here that subsequent 
to the release of the latest NPRDC report tha FT "A" schcol 
courses phases 1 and 2 weze combined into one course; now 26 


weeks duration instead of the previous 23 weeks. 
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(5) Each year, 50 EFICS students would be trained in a four 
year timespan to produce 200 FTMs and in a ten year period 


to preduce 500 FIMs. 


(6) The course cost disccunting rate is used for 4- and 


10-year hcrizons. 


(7) EPICS student distribution per year would be a uniform 


mix of ETT and STT students. 


It was assumed that EPICS and CPS formal training 
costs were equal (per week per graduate) except for costs 
allocated fcr student travel and per diem. The fellcwing 
assumpticns were made to develop appropriat= travel and per 


diem estímates: 


BETT and STT schcels would be single-siced at San Diego 


and Mare Island during EPICS test and evaluation [Ref. 6]. 


(2) CPS scheol costing data indicated that student travel 
constituted an average of 3.3 percent of training costs 
[Ref. 7]. 


(3) An equal nunber cf ETT and STT trainees traveled between 


the east and west coasts. 


(4) Travel and per diem costs for ETT and STT were 31,354 
and $1,5€5 respectively, based on an arithmetic average for 


travel. 
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TABLE I 
NPRDC CPS/FEICS School Travel Scenarios 


| 
| 
| 
| 
Scenario School Location Travel Status* 
| 
CPS | 
| 
1 Recruit training Great Lakes --- | 
BES E r2at Lakes PCS | 
FT "A" (1 & 2) Great Lakes PCS | 
NSSM SNCI Dam Neck or | 
Mare Island PCS 
"n. i l 
2 "ecpuscetra:nmg San Diego =. | 
BE&E San Diego Des | 
BI MART E 2) Great Lakes an | 
NSSMSUSCH Dam Neck or ( 
Mare Island PCS | 
| 
3 a trairing Orlando ee | 
orlando PCS | 
ZI ua & 2) Great Lakes PCS | 
NS SMS H Dam Neck or | 
Mars Island | 
| 
ROTCS 
| 
1 Recruit training Great Lakes === | 
ENT San Diego TDY | 
SET Mare Island EDY 
2** kocruüuit taining San Diago --- 
ETT Sam IN TDY 
SIT Mare Island TDY 
3 Recruit training Orlando -— = 
ELT San Diego TDY 
STT Mare Island DY 


er 
NEU Bese an 


manent change of station : 
evaluat 
nem an Dicgo' recruvitirz=airing pipeline cnly. 


TDY=temporary dut 
ion has included recrui S 


— — D ee ends SD CÃO E D uxo O Do 


i 
E 
E 
E 
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Travel costs for CPS students are already included 
moe GCS training cost figures. Having assumed tha c 
training ccsts for EFICS and CPS were equal per unit tim 
per student/graduate, the EPICS costs then required adjust- 
mene for anticipated travel differences between the two 
raining paths. This was done by (1) subtracting the 
percentage of travel costs identified for CPS travel from 
course ccsts and (2) adding travel costs for TDY travel and 
per diem to EPICS course costs. 

The teaching methodology for the schools in EPICS 
and CFS had to be specified and related to the requisite 
curriculum tc be used to account for curriculum develorment 
easts. ErIes Mand CPS included different instructional 
delivery modes and, therefore, different curriculum method- 
clogiés. The individualized modular method was teing used 
in BESE and FTT courses; in the FT "A", "C" and STT courses 
the ccnventicnal lecture method was utilized. 

The following assumptions and definitions related 
specifically *o curriculum types were used in estimating the 


costs of the two instructional techniques. 


ct 
O 
f» 


Nu The EPICS ETT curriculum vas designed to be similar 


SemoinNacion of that in BESE and FT "A" (Phase I): 


Ri the EFICS STT curriculum was designed to be similar to a 
Gembinaticn® of that im FT "A" (Phase II) and Nooo ac 


(combined) schools. 


(3) Curriculum develcpment costs for CPS and EPICS wera 
considered equal in terms cf cost er module and cost per 
unit time of instructional material developed. (4) EPICS 
ETT course development cost was computed to be $20,000 per 
module, which was used to estimate tae ~CUtE Leu dum 
develcpmert cost for the 30 module comprising BESE. (5) 


BOTES STI ccst per week of instructional material developed 
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was ccmputed to be $5,500, which was used to estimate the 
cost of developing curricula for FT "A" (Phases I and II) 
and NSSMS "C" (ccmbined) schools. : 

Job readiness parity was defined earlier as being 
Seeained in EPICS threugh formal course work (ETT and STT). 
EPICS alsc includes self-study courses work using self-paced 
instructicn in variots career stages. The development costs 
for these modules were totaled at an expense of £362, 330 
using the one, five and one percent maintenance ratios 
menticned above. A one-time development /oroduction 
investment of $362,330 and the varying discounted recurring 
mintenarce costs were amortized over ten years of economic 
life. 

Jcb-performance-aids (JPAs) were developed for EPICS 
to aid the technician during maintenance duty performance on 
the NSSMS at a competency level commensurate with shir and 
system requirements and the individual's skill background 
and experience. Again, at the time of the Megräitchian 
(1983) study refcom 4 two tyves of JPAs had been developed 
for use at the apprentice technician levels; these are the 
Partially preceduralized jok performance aid (PPJPA) and the 
fully preceduralized jcb performance aid (FPJPA). Primary 
differences between the Two are che degree O£ 
proceduralization, the number of illustrations included, the 
level of detail included, and the complexity of tasks 
represented. 

Deucsopmsnteestort for both types of JPAS included 
front-end analysis, task analysis, and job design, all 
falling in the engineering analysis cost category, which 
comprised 94 percent of total JPA costs. That value was 
within  dccumentation cost guidelines for development of 
normal tc ccmplex procedural material (67-97%). In deter- 
mining the cost of JPA development and production, actual 


Bemeractcr costs were used. The combined JPA net present 


2:5 





value was $824,200. In erama ing production and 
develcrpment costs fcr an equivalent number of maintenance 
requirement cards (MRCS) it was hypothesized that a ccst 
compariscn would be much more valid if the contractor devel- 
oping and producing JPAs were to provide cost data for 
developing and producing MRCs. Therefore, estimates were 
made on (1) the number cf procedures that are directly 
equated to the number of MRCs and (2) the average number of 
pages per prccedure. 

The areas of administrative program material and 
staff support were more difficult to assess than any of the 
other variables mentioned above. Before deciding to include 
Er not include costs in this category, consideration was 
given to whether or not: (1) the cost would be incurred 
Marino she actual operational implementation of EPICS, and 
(2) Enc cost-uincurrzingseffort might be performed 
routinely by established organizational personnel or require 
additional resources. It was determined that a ccst item 
Auld be allowed and counted if effort or a resource: (1) 
was expended during general implementation, and (2) could 


not re acccmplished Icutinely by existing resources. 
2. Data 


The formal training cost estimates were based on 
EE 71979 Couzss Costing System (CCS) statistical data. 
These data reflected the cost per student values for PESE, 
A" (Ehases 16 2), and NSSMS "C" schools. Tables II and 
III summarize costsystudent and costs/equivalen+ graduate 
EDS. and EPICS . formal school costs as estimated by 
Barditchian (1983) [Ref. 4). 

The report ccntains other data tables on Individual 
E n?ng Ccst fcr CES/EPICS, EPICS and CPS Training Cash 
Hw (Single Student, 6 year obligor), EPICS and CPS 
Curziculum Develcpment Costs, EPICS and CPS Curriculum Cask 


26 





| 
| 
| 
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TABLE II 
CPS Formal School Costs 


Cost/Student CPEG** 
Item Course/ Dur ation (5) n 
# schcol (Weeks) 1979 198 1% 1981 
1 EESE 10 "200" 3.872 4,178 
2 FT "A" (Phase 1 11 32 5990 25012. 35 4,346 
3 FT "A" (Phase 2 12 3,500 74,235 4,498 
ü —NSSMS "c" (FSC Ze 13,9006, 25 AT, 299 
S  NSSMS "C" (GRIS) 10 6,000 7,260 7,688 
ISS US 8 C  mCecnp. ). 26 15,364 18,590 19,687 
Toral (tens 2,3, and 6 only) 32,799 


*Reflected cost per student in 1981 dollars, assuming 
Fem percent ınrlacrıon per year since 1979. The con- 
gene cA OC tht lating first and dxscountaing later is 
used (DCD, 1972). 


**The cost per student wa 
equivalent graduate (CPEG 
relaticnship: 

CPEG=Total Course Cost/Equivalent Graduate 


EG=(Tctal Course Student Weeks 


S converted St per 


| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| , using the following 
| 

| 

| 
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Minus Total Course Attritees Weeks) 
divided by Total Course Leng-h (Weeks) 
| | 
| | 
DC e ee ceca a eS a SS MS. muris MM armen onen 
Flow Data, ERES InSceructional Module Costs, EPICS 


Instructicnal Module Cash Flow, NSSMS JPA/MRC Comparison 
Lata, ETCS Jot Performance àid (JPA) Cash Flow Lata, 
Technical Publication Unit Costs, CPS Maintenance 
Requirement Card (MRC) Cash Flow Data, EPICS Administrative 
Material and Staff Support Cash Flow Data, Training and 
Ame lary Cests of EPICS and CPS and Cost by Basis for 
Compariscn. For the sake of brevity and the focus of the 
m@esizS on the initial skill training segment of the two 
perscnnel systems being studied, these tables will net be 


summarized. 
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TABLE III : 
EPICS Formal School Costs 


| 
CPEG CPEG 
| Item Course/ Duration Cost/Week Uncorrected* Correct** 
| TE School (Weeks) $ ravel Travel 
| 1 ren 14 SS 5,330 6,700 
| 2 STE 18 254 13,026 14,761 
| 
*Pased on CPS weekly cost per equivalent graduat= 
| (CP EG with imbedded 3.3 percent CPS travel cost. 
**Eased cn estimated EPICS TDY travel cost. | 
CE E 555 


Oo» dao O cs ico came qua 


The EPICS test and evaluation project has provided 
Ene) career path and most component costs for technical 
preparaticn for both personnel systems. The trainirg path 
and support structure for each personnel system was deter- 
mined. Twc cohcrt pcpulation levels wer? hypothesized for 
eating for each path: one o ZOO. FINS,» <O De- -consistent 
ith initial estimates of che EPICS test and evaluation 
populaticn, and one of 500 FIMs, to represent long-term 
NSSMS requirements. [Givedtidl  @raingng “and ancillary 
Support costs for each population were estimated, 
discounted, and expressed in terms of base year dollars. 


Finally, the cost components for each system were aggregated 


and expressed in terms of net present value (NPV) and 
equivalent uniform annual cost (EUAC). Costs allocated to 
formal training included those items identified by Navy CCS 


RENE ne categcries of labor, supplies, contracts, etc., for 
cost items such as travel, pay, facilities, housing, cver- 


head and support. 
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| 
| TABLE IV | 
| EPICS and CPS Training Cash Flow Data | 
| 
| 
| Project* Student Amount $ Discount Cost | 
| Year CONOC emenccucr og Fact or | 
| (10% Rate) | 
| EPICS l 
| 1-4 200 (50 | 
per year 1,073,050 32326 3,568,964 NPV | 
| 1-10 500 (50 | 
| per year 1,073,050 6.447 6. 917,953 NPY | 
| 1,073,050 EUAC | 
| 
| CPS | 
| 1-4 200 {50 | 
rer yəar 1,635, 450 35 26 5,439,507 NPV | 
| 1-10 500 (50 | 
| per ysar 1,635,450 6.447 10,543,746 NPV | 
| I 1525354050! 950 AC-2 1 
EE PUssccun-zng rericd in years. | 
| NEV=Net Present Value | 
Í EUAC=Equivalent Uniform Annual Cost | 
! 
BEEN o os o LL 


Training costs were estimated tor preparing 200- and 
500 perscn groups of Nato Seasparrow Missile System (NSSMS) 
Mere Cccontrcl technicians (FTMs) via the EPICS and CPS 
training paths using a common level of total job prepared- 
ness achievsd thzough both the EPICS and CPS pipelines; the 
distircticn between the two tracks being that the primary 
EPICS training goal during the early years of enlistmer* is 
achievement of job readiness and not academic maturity. 
While academic equivalence is attainable via EPICS, it comes 
later when the choices about job sveciaity and career orien- 
taticn have been decided. In terms of job preparedness 
parity, EFICS and CPS were considered equivalent act NEC 1148 
ata ificaticn. 
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Tte findings cf the analysis were determined  -*c be 
preliminary at best; however, empirical evidence presented 
in the report suggests that: (1) EPICS can be expected to 
reduce initial skills training investment cost leading to 
FTM NEC qualificaticn by approximately one-third over the 
current training approach; and (2) EPICS provides an 
Epportunity for cost reduction in technical preparation, 
even when ancillary support costs, including curriculum 
devealcrment, instructional modules, JPAs, and staff support, 


are ccmbinred with training costs. 


PER THESIS COST ANALYSIS 


1. Assumpticns 


Cne of the underlying assumptions of tha cost 
analysis of this thesis is that the program develcrment 
costs allccated to EFICS will be treated as sunk costs as 
Meee the costs of maintaining the training facilities, and 
travel [ Ref. 8: DJ Tha reason For doing this is to 
analyze tte +wo perscnnel systems in terms of a long-run 
planning and decision-making scenario. 

Cnce the R 8 D vhase of EPICS is determined to be 
st/2ffecti 


© V 
the “WC processes and choose one over the other as a vehicle 


ct 
O 
(D 


complete pclicymakers will review ne 
for develcping the best qualified technician at least cost. 
At that point in time the programs will be evaluated r=la- 
Mee te ccsts for routine operation, student volume, 
meenuiting personnel, etc. 

For these reasons more current cost values will be 
utilized and net present value calculations performed only 
in those instances where the cost differences are clearly 


Gieesinc= and identifiable with one system or the other: for 
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example, when equivalent training is conducted at different 
points in the careers of individuals within the two systems. 
Also, inflation will be ijanorsd because no (Ref. 8: p. 10], 
because re salient evidence exists to indicate that the cost 
cf either the conventional or integrated systems will fluc- 
tuate mcre cr less than future inflation ratas. 

A final assumption is made about initial skill 
training. For the purpose of this analysis initial skill 
training is defined as that training received in preparation 
ESNCKOII progression training or "Ct" school training. For 
example, in the conventional system initial skill training 
for the FI rating would include BESE, FT "A" school Phases 1 
and 2. Skill progression, or "C" school training would be 
equivalent to the NSSMS course of instruction. Ds 
distinction will be more apparent in the cost analysis to 
folicw. 


2. Lata 


The data used in this cost analysis ars lceng-run 
average ccs- processed from the Chief of Naval Education 
Training (CNET) Per Capita Cost (PCC) database [Ref. 9]. 
These are the lcng-run average costs per  student-week for 
Er "A" schocl iritial skill training pipeline (befcre 


*he ccnversicn of phases I 8 II to one course). 


These costs per student-week do not include th 


(D 


costs asscciated with the students’ attendance. They ar 


n" 


mee. the cost of rroviding the training -- instruct 


4 


O 
Salaries and allowances, etc; the cost of supplies and 
maintenance, etc. Although raw data was preferred for this 
analysis, it was unattainable from CNET due to perceived 
problemmatic procuremert, SOLZ ing; Duterbpretatuicon. 
reliability/validity and timeliness issues. 
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TABLE V 
FY 1981 Lcna-Run-Average Costs (LRAC) 


| 
| 
| 
| | 
| | 
m CDE ERES Long-Run Average cost | 
| per student-wask | 
| 6359 79 110 | 
| 
| 6377 75 100 | 
m 6376 82 161 | 
| wheres, CLP 6359=BESE in San Diego 1 
| CIP 6377=FT "A" Phas> I in Great Lakes, IL. | 
| CDP 6376=FT "A" Phase II in Great Lakes, IL. | 
| | 
Mm EA 9 10 5 o o Ed 
3. Methcdolcay 
When analyzing the discounted present value 


(0 
+ 


ct Ul 


criterion for investment, a specific mathematic fcrmula 


used to ccarute the amount of mon that is to be paid a 


rh 


ey 
en erent periods in time; given that one dollar +oday iso 
more value than a dcllar that is paid at a ater period 
(Ref. 10: p. 439]. From the view point of the investor, in 
this case the Navy, today's dollar is bes- invested tc earn 
metes: at the current rate, a TO delay che investment 
could incur the loss cf interest, a benefit foregone, and 
eec Ely result in the inability to obtain a good or 


resource, perhaps a human resource, at a later time. 


Ine ehis thesi the net present value formula is 
Med ir a cost comparison of initial skill training 
investments for 1148 NEC FTMs with 4 year obligations (KYO). 
Due to recent changes in contract length requirements it may 
no  lcnger be possible to strike for FIM with a 4 YO 
contract. Nevertheless, the 4YO, FTM assumption serves as a 


wm icient proint of departure for this analysis. ei 12 Zang 


32 





| 
| 
| 
| 


TABLE VI l 
Net Present Value Formulae 


Se eee 


dollars 
O 


ge eral, a doliar today grows -o (1 
E one 


n (1+1) 
year. The fcrmula fôr present value 
DEUS 


$1/(1*r), which is 


amcunt to be invested today at an annual interest 
, 


yield cne dollar in one year. 


¡aa AAA le, RO o una lon E La E O. 


sc, the present value of one dollar payable in some 
mter of years, 


n 
: EN (+r) , 

where for a series of payments in years 1, 2, and 3 
net present valu2=1/(1+r)! + 1/(I+r)2 + 1/ (1+7)3. 


ea a en a E om 


| 
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| 
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the seccnd fcrmula presented in table six, a general compar- 
iscn can be made between “he EPICS and CPS personnel systems 
Belative tc initial skill training. Ly feno NERDC report 2+ 
was assumed that: (eee EPICS ETT school curriculum was 
designed tc be similar to a combination of “hat in BESE and 
meee A" (Fhase 1) schools; and (2) the EPICS STT school 
curriculum was designed -o be similar to a combinaticn of 
that in FT "A" (Phase 2) and NSSMS "C" (combined) schools 
(Ref. 4: ESTO: This assumption is carried fur-her in 
that if the curricula are similar “hen *here are cos- simi- 
larities in the methcd of presentation, the quality cf the 
instructors, as well as the facilities and supplies keing 
alized, etc. Thus, using the long-run average costs in 


table VI, the NPVs fer EPICS and CPS were approximated. 
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Amo rails ka training consists of ETT and 
STT; based on the abovementioned similarities, the cost of 
ETT is approximately equal to $110 + $100 per student-week 
for 14 weeks; $210 x 14 = a cost of approximately 32,940 per 
student. The cost of STT is approximately equal to 
$2,940/.41; about $7,171, with some proportion cf that 
amount attributable to the costs of the FT "A" (Phase 2) 
equivalent cf the STT curriculum and some proportion attri- 
butable tc the NSSMS segment of STT; just what value the 
proportions may be is beycnd the scope cfr this study 
particularly since the calculations presented here are 
academic estimates used to facilitate the analysis cf the 
EPICS and CFS personnel systems (the ratio  ETT/STT, using 
CPEG uncorrected for travel, was used to calculate a percen- 
tage value cf ETT relative to STT; Thus, an estimaticn of 
STT ccst is then possible using the LRAC data available for 
this ccst analysis) (Ref. 4:  p. 8]. The total NPV estima- 
Rn Cor EPICS initial skill training, for a fcur year 


mlmcc, 25 apprcximately $8,599 and for CPS, $4,197. 


However, the $8,599 NEV for EPICS reflects more tkan 
initial skill training as defined in chapter one and the 
Beeumrticne for “his analysis. In reality, the NEV for beth 
EPICS and CPS may be near equal since EPICS has integrated 
skill prcgression training for the Nato Seasparrow Missile 
System (NSSMS) with phase II ini 
Ens. The EPICS path may be a mc 


scheme simply because the EPICS student at the 2-year career 
n 


eo eski training foL 


I^ 


= 


Q 


OSt-effective training 


point has more "Navy experience" administratively, 
culturally and technwecally, than a CPS courte: tame. 
Essentially, via EPICS, The NSSMS "C" school becomes acre 


meme “skill progressicn" type course it is labeled in CPS. 
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RM ——— 
| TABLE VII 
| EPICS ws. CPS NPV Comparison (LRAC) | 
| | 
| 
EPICS | 
| | 
| 0 1 2 3 4 | 
i ee ME a | 
| D $2,440 is b. m | 
ES 2672 1 | | 
| E2026.  — eee | 
Eis 599 | 
| eS 
| 
ENEMES ss Cine deco P | 
| re gn j. * d+ | 
| 1,070 i 
| 1,884 | 
| $0,197 | 
| *Assuming no other rating related training | 
| investments are made during the four year | 
| period. 
| | 
j————————————————————————————————————————————————————————A od 


Also, it is important to not2 here that the EPICS 
NPV schematic demonstrates that the best option for cost and 
effectiveness may actually be to train only for what is 
necessary to perform the job assigned. For example, an 
EPICS sailcr will receive BESE and FT "A" phase I equivalent 
training; and, upon reaching the first sea assignment, the 
EPICS sailor will perform approximately three months mess 
Cooking/ccmpartment cleaning and approximately nine ıcnths 
in an NSSMS related werk center. Assuming the EPICS sailor 
Res received the "preper" amount and "type" of training for 
the respensibilities and duties assigned during those first 
twelve months aboard ship, a sailor trained via the CdS 


pipeline, arriving at “ha same ship, at che same time, to do 
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the exact same tasks as the EPICS sailor, will be signifi- 
cantly "cvertrained" as suggested in chapter one cf “his 
thesis. 

The utilization of job-peformance-aids permits EPICS 
sailors to function within the work center using skills that 

re specific to the shipboard werk center. Valuable, more 

generalized, electrcnic theory and systems applications 
training is delayed until later in a sailor's career. Thus, 
Seven a ilicnger initial contract, such as six rather than 
four years obligated service, Navy training could beccme 
more of an incentive to remain cn active service rather than 
a disincentive; expensive, generalized "education", not 
training, useful for employment outside the military, and 
also used asa recruiting tool in the military, contrikutes 
to reduced retenticn among skilled military technicians 
fRef. 117. 

Fecr a better comparison the NSSMS "CM (combined) 
LRAC is estimated as follows: sing CPS formal cost 
estimates in table II NSSMS "C" costs were calculated to be 
Momo: EESE and FT "A" T and II costs; whera BESE + "A" I + 
pa 11=$10,872, NSS MS (combined) =$15,364 and 
mero 7 2/515,304=.66. Therefore, $4,197/.66= $6,359 and, the 
approximate long-run average cost for thse CPS equivalent tc 
EPICS is $6,359 + £4,197=$10,556; so, these LRAC based 
estimates indicate a cost difference of DOMO TIS or 
Eu valent training; $1,957/7510,556 is approximately .19 
which is irterpreted as a 19% savings for using EPICS as 
Emuoced tO CPS. fcr 26 weeks of instruction the cost of CPS 
meets "C" is $6,359/26, approximately $245/wesk. 

Another aprroach to evaluating the training 
investment decision is to calculate the discounted present 
valus of the stream of revenues earned by che Navy asa 
Meee: Of investing in training. This is the most difficult 


cost analysis since the Navy does not earn what could be 
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truly called "revenues", The product of trained sailors may 
best be described as a subjective, qualitative element; that 
is, it depends upon the environment in which an assessment 
on sailcr productivity is made. For example, what is 
"produced" by an FTN aboard a cruiser is not easily deter- 
mined nor expressed in quantitative terms. Thus, decisicn- 
makers are often fcrced to chocse between policy issues 
using surjective, intuitive knowledge processed through the 


chain cf ccrmand and the DOD bureaucracy. 


Similarly, subjectivity and intuition flavor the 
analysis in this thesis; however, in an attempt to resolve 
mie problem of what EPICS produces relative to what CPS 


produces in terms cf benefit to the Navy, measures of 
effectiveness will be evaluated in the section on Thesis 


ffectiveness Comparison. 
o Cenclusiens 


The evaluated data indicates that the EPICS career 
path costs approximately 19% less than equivalent initial 
skills and skill progression training provided via CPS (per 
student). The findings also suggest that human capital 
cverinvestment may exist in Navy CPS thereby contributing to 
reduced retention amcng potential carserists, shortages of 
skilled technicians at ssa and increased dependence on 
lesser quélified, inexperienced, vounger personnel. In view 
of a projected decline within the pool of males eligible to 
serve in the armed fcrces and an improving national eccnony, 
the implications of this analysis would seem to warrant 
Euecher evaluation of EPICS and other similar innovative 
perscnnel management processes relative to manpower selec- 
Exon and training. 

Assessment of opportunity costs is difficult in this 
analysis without access to valuable raw cost data. Not 


considered in-derpt here are the ramifications of a more 
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TABLE VIII i 
Revenue Net Present Value Formula 


Net Present Value= 
n 
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ame ER ee SS a ee m o 


where, 

E 

is the interest rate, 
R 


is the monetary return or revenue each year and, 
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labor-intensive career system such as  EPICS. It is more 
Bo r-intencive in that the instructor-trainee ratios are 


much lower than in the conventional personnel system. Thus, 


the costs cf wages as well as the time aná skills of 
RR Cpnel supporting EPICS sailors on ship, such as work- 
Enter supervisors, should be allocated to the cost of 
PCS . ic, En orrcrtun'ty for=gone to the sailor teina 
aired via EPICS is the ability to receive desirable 
general training at the government's expense. This possi- 


bee ty Could haves far-reaching effects in times of recruit- 
ment difficulties and manpcwer shor+ages. These are just 
two cf many significant factors decisicnmekers  shculd kse 


in mind when modifying and changing Navy -raining policies. 
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C. SUMMARY AND COMPARISON OF RESULTS 


The NERDC findings suggest cost decreases but. still 
remain tc be evaluated against systems effectiveness 
measures. It is the intention of the researchers to 
investigate effectiveness on the basis of selected variables 
reflecting system appeal, resource attributes, individual 
preparaticn, contribution, job effectiveness, progression, 
Petr ition, and intentions. These variables were selected 
because trey were minimally intrusive, least confounded, and 
highly descriptive of the overall system performance. 

Tbe thesis ccst analysis demonstrates that, in terms of 
initial skill training, the EPICS personnel system delivers 
an 1148 NEC qualified sailor at less expense to the Navy in 


two ways: Gn croyiding)o specific training when it is 
needed and (2) by deferring the training such tha it is 
potentially less a disincentive for retention of skilied 


technicians. However, there are tradeoffs concurrent with 
each of these career paths chat may be justifiable relative 
to the eventual benefits of either systen. 

Assuming that the quality of sailors produced by both 
systems is equal then, according to this analysis, the EPICS 
mthcd is by far the better choice. However, should 
evidence exist tc indicate that the EPICS sailor is far less 
qualified in terms of career motivation, job satisfaction, 
Mere=ude, discipline, stc., then a better choice for Navy 
decisicnrakers may be to forego immediate cash savings in 
return for a more expensive, higher aptitude enlistee who 
would at least be capable of providing some dependatle 
service in the short run. 
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III. EFFECTIVENESS ANALYSIS 


A. NERDC EFFECTIVENESS COMPARISONS 


The following information was extracted from a paper 
titled "EPICS -- A JFA Integrated Personnel System," by Cr. 
Robert E. Elanchard, EPICS program director, Navy Perscnnel 
Research and Develcpment Center (NPRDC), San Diego, 
Califcrnia (Ref. 12]. The presentation by Dr. Blanchard was 
not intended as a comprehensive basis for EPICS and conven- 
tional perscnnel system (CPS) training evaluation. 

Dr. Blarcharä's paper, presented at the Second Annual 
Conference on Personnel and Training Factors in Systems 
Effectiveness spcnsored by the National Security Industrial 
Associaticn, May 6, 1982, describes the integrated personnel 
systems approach  (IFSA), EPICS implementation, the ER IES 
tes: and evaluation plan and preliminary findirgs. 

At the time of the presentation data collection had been 
emaoıng EÉcr approximately 18 months and preliminary fíndings 
were available on: OEE PICS rcr uici ng inducement. poten- 
pas. (2) ate ition fron the EPICS program and from the 
Buy: (3) relative performance for initial BPICS sailors ir 
EuucEmenrt Technician Training (ETT); (4) supervisor confi- 
Ace in EPICS task performance during the first 12 menths 
of enlistrtent; (5) supervisory and EPICS sailor perceptions 
EX the jcb performance aids and shipboard instructional 
modules; and (6) relative costs of EPICS compared -o ths 
traditional perscnnel system. Also a+ that time it peas 
anticipated that data collection would continue fer most of 
these data sets throughout the test and evaluation program. 
Econ actuat performance of EPICS sailcrs in compariscr to 


mee schcci and "C" school graduates, the primary hypothesis 


4Q 





— e en: ay Ee ee ge ee ee ee a ee ee ee a ee SS 


TADSHORE | 
ASSIGNMENT | SEADUTY 
i 
J 


ENTER RECRUIT (72 AT-SEA TECHNICIAN - 3 
NAVY TRAINING ORIENTATION DUTY NEY 
l 


< 
m 
> 
D 


4 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 

EQUIPMENT EQUIPMENT FEN { 

HNICIAN TECHNICIAN 

TEC a h ES F) | 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
4 


nn a A EEE u, ns ss a Te U en ug Te u AT en u ine u oa M cc ne GS, SEDA a ii > 


TRAINING ; UTY 
i 
DISCHARGED 
3&4 | AFTER 4 YEARS 
r7 N 
SYSTEM SYSTEM 
TECHNICIAN 2 TECHNICIAN CAS REENUSTMENT >) 
TRAINING DUTY E5 \ x 
ASSESSMENT 
=- " ADVANCEMENTIN RATE ic cid dd 
cec. ne ae AAA ILLUS A A A A E A, A A A AAA = E A Le LT 





Figure 3.1 Simplified EPICS Career Systen. 


Bene tested, Would Ee collected following completion, by a 
E number of EPICS graduates, of Svstem Technician 
SID , about mid-1983. 


eu COSS of NERDC Effectiveness Comparison 


Tte cbjective of the JPA-Based Integrated Personnel 
System presentation was to identify, quantify and compare 
the kenefits/costs of EPICS and conventional personnel 
systems, relative to the potential performance quality char- 


acteristics among personnel zzained within each system. 
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2. NERDC Conclusions 





From the presentation on EPICS as a JPA-Based 
Integrated Fersonnel System the following were suggested: 

Ta It seemed that a deferred training program with 
early at-sea experience was attractive to the prospective 
Navy recruit as long as there was some assurance that tech- 
nical schcol (electrcnics in this instance) would be avail- 
abl= at scne point. 

2: Attrition data suggested that overall attrition 
from the Navy with EPICS was about on par with cther 
programs, amounting to about 84%. Noria tension from the 
program, an interesting finding was that the "eligible" 
cohort of EFICS sailcrs appeared to pe leaving the pregram 
at dcuble the rate cf the "ineligible" group (12% ccmpared 
20157), Pipa co anel g Dility for Che FIM rating is a 
function of scores on the Armed Services Vecational Aptitude 
Battery (ASVAB) as fcllows: MK + EI + GS = 156 + AR = 218 
wnere MK-zMathematical Knowledge, EI=Electronic Information, 
GS=General Science and AR=Arithmeti Reasoning. These 
subtests are used to predict success in the FTM rating. The 
Summarized score of 218 is a minimum desired qualification 
Score, cut may be waivered to as low as 208 depending on 
circumstances and manning levels. It is assumed then that 
EPICS students referred to as eligible and ineligible in the 
NPRDC reperts included personnel who achieved scores greater 
than or equal to the 218 score as well as personnel who 
scored belcw 218. 

C T nent Technician Training (ETT), «he "ineli- 
Bet grcup performed cn par with the comparison group, 
whereas the "eligible" group appeared to be superior tc all 
ESUPSI:SCD groups on module completion time criterion. 

4. Supervisors indicated a high confidence level in 


EPICS sailors performing prescribed tasks using FPJPAs. 
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S. User acceptance of EPICS was not yet clearly 


demcnstrated. 
e mgen ral ztiındınas at tha= time on th2 EPICS 
field evaluation seemed to Jusco: eaut ious “Corl nicn, 


althcugh it was much too premature relative to program test 


and evaluaticn fer any definitive interpretations. 


Bee toetolS EFFECTIVENESS COMPARISONS 


This is a 'first-look' effectiveness analysis cf eleven 
EPICS graduates, NEC 1148 qualified, as compared to seven 
FTMs who are also NEC 1148 qualified via CPS and a sample of 
628 CFS FIGs/FTMs whe are NEC 0000. 


1. Data Selecticn 


A cchort of 206,229 cases was being evaluated at the 
Naval Postgraduate School during Winter,1983 in conjunction 
with an NERDC-sponscred Navy Enlisted Standards project. 
The cchcrt database consistsd of several files that were 
Matched on social security numbers by the Defense Manpower 
Data Center, Monterey, CA. These files included Navy Health 
Research Center (NHRC), Enlisted Master Record (EMR), Navy 
Integrated Training Resources Automated System (NITRAS), 
Defense Manpower Data Center  (DMDC) files and Navy 
Advancement Iata on service members who had enlisted ir the 
Navy ketween 30 September 1976 and 31 December 1978. 

[ue to the rich content of vhese files they were 
made available to several Manpower Personnel Training 
Analysis (META) students for thesis tesearch. Such was the 
case with the sample of FTs (NECS 1148 and 0000) used in 
this analysis. Once the files were successfully matched and 
the variakles of interest labeled, the data was screened to 
eliminate potential errors and extreme values that could 


distort any statistical aralysis being dore with the files. 
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Since the EFICS test and evaluation program was 
being conducted with FIMs, “he cohort was screened for 
perscnnel having either the rate abbreviation FT, “FTG or 
PEN; when this was done frequency distributions were 
requested fer the follcwing variables: (1) DMDC NEC; (2) 
total number of days to E2, E p. (3) ASVAB subtest 
scores; (4) tine in rate; (5) length of service; (6) 
advancement exam rate; (7) advancement exam paygrade; (8) 
present rate; (9) present paygrads (10) total days ua/awcl; 
(11) total rumber of promotions; (12) total number of demo- 
tions; (13) pay entry base date; (14) estimated termination 
of service date; (15) entry age; (16) entry paygrade; (17) 
highest educatior level achieved; (18) AFQT percentile (or 
equivalent); and (19) AFQT groups. 

Lata on the eleven EPICS graduates was obtained from 
NPRDC Code 17 out of the EPICS database, current as cf 24 
May 1983. Variables were matched as closely as possibie to 
those available for the CPS 1148 and 0000 FTs on the Navy 
Enlisted Standards cchcert database. 


2. Methodology 


These variables were first evaluated using the 
e tistical Analysis Systəm's (Ref. 13], Stepwise 
Discriminant Analysis ina two-phase analysis relative to 
input and output measures. Input measures, for example, 
were entry age, ASVAB subtests, highest education level 
achieved and entry payarade. The output measures were time 
RE grade, days tc prcmotíon, length of service, total promo- 
tions, total iemotions, “total ua/awol, and total desertions. 
Four possible analytic outcomes were of interest: (I): ir 
inputs were not significantly different, were the outputs 
significantly different; (2) if inputs were significantly 
ENM crerct, were the cutputs not significantly different: (3) 


if inputs were not significantly different, were the cutputs 
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also not significantly different; and (4) if inputs were 
ENnsfscantly different, were the outputs also significantly 
Eutfterent. 

Subsequent tc the stepwise discriminant analysis a 
frequency table was produced and from that 16 variables were 
deemed worthy of further study (see Table IX) using “he SAS 
PESCRIV procedure. 

The DISCRIM procedure of SAS develops a discriminant 
model fcr a set of observations containing one cr more 
continuous independent or descriptive variabl=s, and a clas- 
sification variable whose values define groups for the 
cbservaticns; DISCRIM uses the model to classify ¢ach okser- 
vation into one of the groups and then summarizes the per- 
formance of this discriminant model. For the variables 
listed atcve the results were as indicated in ‘tables X and 
XI. These results indicate the probabiiities of a member of 
Ene lcazegory belonging or "fitting invo" another category. 
The DISCRIM procedure performs this analysis based on a set 
of data and then applies those answers to a test sample. As 
shown in Table X and XI this is what has been done with the 
datasets "CALIBRS" and "VALID8"., 

The EPICS sailors do appear to be a very different 
group of personnel as compared with «he CPS 1148 NEC 
sailcrs. According tc table X there were 0 percent of cate- 
EREM OS sailers classified into category 2 but 25 percent of 
bl 


XI confirms the results in table X with 0 percent of categoy 


iD 


fu 


the category 2 members were classified to category 3. 1 


3 classified to category 2 as well as 0 percent of category 
Pecaassified to categery 3. 

Additional statistical analysis was done using the 
SAS procedure, General Linear Model (GLM). The GLM proce- 
dure is a regression procedure that handles classification 
variables -- those that name discrete levels -- as well as 


continuous variables which measure quantities. GLM can be 
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TABLE IX 
Cohort Stepwise Discriminant 


| 
| 
| 
| 
| 
| 


Analysis 





| 
| 
Variables 1 SUS 69 10 12 13 14"15- 16 Total | 
ASVAB WK * * == 2 
ACVAE AR X "* + $ * re x * -- 8 | 
ASVAB MC * E 1 
ASVAB NO * == 1 | 
ASVAB EI = * > 3 | 
ASVAB MR x * * "« e d 5 | 
ASVAB GS * S a TE 4 | 
ASVAE AD ER * * x E- 6 | 
ASVAB SI * B p 2 
ASVAB GI LE * xig * * 7 | 
ASVAB SP * x x 4 ox x * * -> x 1 | 
| ASVAB Al * + wer E 5 | 
| ENTRY AGE = A E X ik * == 7 
HIGH ED * -= 1 
| AFCT ECT E 0 | 
| AFCT GRP = 0 | 
ENTRY EG * * x * x x x x -- * 0 | 
| BEICS NEC = 0 | 
MO LOS Fe 0 | 
DAYS E2 * $ X x = 4 | 
ENDAYS E: * -- 1 | 
| DAYS Eu * -— 1 
HOT DEMO * m 1 | 
TCT UA x x x * xe x x -- * 8 | 
| TOT PRCM ko * er > | 
| COT DES m 0 | 
| where, sixteen random Samples were selected from the 6281 
| "0000! FTs and labeled category 1; See 2 consisted 
Se che seven %1148" nec FIs from the cohor* (these 7, 
| once identified, kecame a a group of FTs from an 
Sergind! coher* sample of 845 FTs); and ES T 3 | 
was a sample of eleven EPICS graduates. The '1148' nec | 
| FTs in category 2 were CPS personnel. | 
| The same analysis was run (run #17) with the tcta | 
fr 628 satple of '0000'! FTs, the EPICS '11 ' and the | 
| CPS '1148' datasets. o | 
All the variables shown as significant for run 17 | 
| as wall as the variables (runs 1 - 16) E | 
]  frequencies oí 2 cr more were selected r the | 
| SAS discriminanti analysis. | 
| These were ASVAB AR, WK, EI, MK, GS, AD TG Tu ; | 
ATI, Entry age, sntry paygrade, Sumber of ays to i | 
Total number óf demótioné and Total nunb of UA ou | 
| | 
| —————— nn —— MNA —€——————H 
used with simple regression, multiple regression, analysis 
of variance (ANOVA), especially ptor upbalanced date, 
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analysis of covariance, response surface models, weighted 
regressicn, partial ccrrelations, multivariate analysis of 
variance (MANOVA) and numerous other techniques. 

Using the Duncan Multiple Range Test and Least 
Squares Means steps of the GLM procedure in SAS, some indi- 
cators of hcw well tbe three groups o£ FTs compare statisti- 
cally are provided as classified by category. 

The variables that did not demonstrat2 any signifi- 
cant differences among “he three groups were: (1) input 
variables -- highest level cf education achieved, ASVAB 
General Infcrmation, ASVAB Numerical Operaticn,  ASVAB Wcrd 
Knowledge, ASVAB Arithmetic Reasoning, ASVAB Mechanical 
Comprehensicn, ASVAE Science Information, ASVAB Arithmetic 
Informaticn and (2) output variables -- number of days to 
E3, total number of promotions, votal number of days 
ua/awcl, and total number of desertions. 

Tte variables that show some variation among the 
three categories are summarized below with relevant statis- 
tical results and some suggestions as to why the results are 
as indicated. 

Tke results in Table XII ars not surprising since in 
ma ct the electronics ratings it is possible to enter the 
Navy at a paygrade higher than E1. The data evaluated 
suggests that some members of categories one and two entered 
the Navy via special rating guarantee programs such as thes 
Advanced Electronics ield (AEF) progran. In gs 
analytical summary the members in category one cculd be 
viewed as the "normal" population and categories two and 
three as subsets of that population, occupying the high and 
low tails, respectively, of a normal population distribution 
eucve. 

Table XIII presents possible substantiation of che 
results in Table XIT; the persons in category two 


demonstrate a relatively high mean entry vaygrade and were 
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also an cider group when they enlisted in in the Navy. 
Since these people are older it is possible that thay have 
some previcus experience or training involving electronics. 

Again, there is further evidence that the members of 
categcry *wc are a very different group of enlistees. None 
of the CES 1148 sailcrs entered the Navy as Els and thus, 
were most likely recruited via some Advanced Electronics 
program that guaranteed specific training and earlier promo- 
mom to E2/3. The EPICS sailors clearly take longer than 
Aer: category two cr “three sailors for promction to E2 
since they are follcwing a career path that more clesely 
resembles that of the general detail (gendet) sailor at this 
point of a naval career. GENDETS receive immediate fiset 
assignments via 4-6 weeks general apprentice training 
courses subsequent to completion or basic training. 

Table XV would seem to suggest that while some 
enlistees in categories one and two benefit at entry with 
some guaranteed immediate technical training and early 
advancement to E2, there is almost a year delay fcr for 
Beemoticn tc E4 compared to the EPICS sailors. Thers could 
eas everal explanations for this; one of which is the time 
pericd cf the data. Frequently, advancement exam/promction 
Cycles change relative to the manpower demands of the Navy; 
that sesıs tc be the case here. Both categories one and two 
take nearly 24 months to achieve pett officer staus 
whereas the  EPICS personnel became E4s in about one year. 
Gm@erentiy there is a significant shortage of qualified petty 
officers as well as FIs and FTMs in the Navy; thus, it would 
not be unusual for rates of advancement to be very gqceod 
among the EPICS people. It is entirely possible that such 
was not the case for persons entering the Navy between 
September 30, 1976 and December 31, 1978. Also, =— It 1s not 
unusual for time in rate (TIR) and time in service (TIS) 


requirements to change every two or “hree advancement 
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cycles. ie ace today there ie ne TIS reguirement, only 
PIR. Thus, this data may not be relevant as an output 
measure. l 

Numerous undccumented perceptions and ideas atound 
concerning factors that contribute to variables such as 
demotions. In this example, it appears that a significantly 
high occurrence of  demotions is evident among the group of 
people whc, according to the previous data, were the 
"better" qualifisd enlistees. Intuitive reaction to this 
table is that given the sometimes rigid, discipline-orisnted 
environment of the Navy, Gideon, intelligent" ‘enlistees 
sometimes experience difficulty coping wit routine proce- 
dures that in another environment could be viewed as quite 
pxrIvial. Also, shculd that perception exist, members of 
category two are most likely capable of finding emplcyment 
external to the Navy and are not reluctant to so remind 
their immediate superiors either verbally or by their 
kehavior; asa consequence, these kinds of service members 
usually pay a price for such indépendence via loss in rank 
and ccmmensurate inccme. 

Table XVII presents some very interesting evidence 
meee Tay be significant for BEICS. It seems intuitive «hat 
the CES 1148-qualified sailors would rank highest on this 
variakle due to their higher aptitude. Again, assuming that 
the CFS 0000 sailors represent a "normal" population of FTs 


then, tke EPICS sailcrs are somewhat above average in +heir 


aml ity to pay attention to detail. Presumably, one is 

attentive tc something one is interested in and therefore 

desires tc excel in performance relative to that interest. 
1 


While the EPICS group is, overall, ranked somewhat lewer in 
evaluaticns cf general aptitude it is encouraging tc note 


such a high average score for this variable. 
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The variable spatial perception may frequently be 
overlccked as an indicator of skill/ability relevant to 
technical learning. Nevertheless, as with table XVII the 
evidence seems +o suggest that spatial perception may have 
some “significance in terms of learning and applying new 
ideas. As FPICS continues, Turcher ınWestigation of this 
variable with other EPICS groups may provide additional 
sight. Table XIX does not demonstrate anything new or 
enlightening. Given the backgrounds of the three groups and 
the results of the earlier tables these figures are nor 
surprising. 

The results of table XX further substantiate tables 
Bear, XIII, XIV and XIX. Category two members most likely 
have enlisted in the Navy with some previous training/ 
experience in the electronics field; Table XXI also 
parallels table XX. 

The LSMEANS ANALYSIS looks at the probabilities of 


members within one category differing from members in th 


D 


cther twe categories. For entry paygrade each, table XXII, 
category seems to be very different with little chance of 
members in categcry cne or two being in category three and a 
scmewhat better, thcugh still small, chance of one and two 
being members of the same category. The following tables 
provide further substantiation of what was presented in 
Toles XII and XXI. 

Table XXIII, suggests that there are aqe similari- 
ties tetween the EPICS graduates and the NEC 0000 group. 
Again, “hs CPS 1148 group, category two, seems to be quits 
different in terms of entry age as compared to either cate- 
gory cne or three, 

Each of the categories again do not seem to share 
any major similarities with each other on the number of days 
to E2; the data in table XXV may not be useful for reasons 


indicated above for table XV. Table XXVI suggests that the 





EPICS students may have a lesser tendency to be demctad “han 
“highly qualified" CES 1148 NEC personnel for reasons cited 
earlier. Further investigation of other graduates may rein- 
oree this conclusion. 

Tables XXVII and XXVIII are interesting input vari- 
able indicators of similarities between NEC 1148 EPICS and 
CPS perscnnel. Füttre studies of EPICS graduates investi- 
gating these two variables should provide additional insight 
into the kinds of people the Navy may want to consider for 


selection into the highly technical ratings. 


3. Thesis Cenclusions 





The data, as evaluated presents no shocking 
surprises. It is interesting however, that in terms of the 
input variables, the EPICS members seem to demonstrate that 
while their aptitude scores are average, they are capable of 
performing  satisfactcrily such that all eleven graduates 
have attained the criterion of the 1148 NEC and all eleven 
have attained petty officer status. 


C. SUMMARY AND COMPARISON OF RESULTS 


How much cf the EPICS sailors! success is attribu 

to the EPICS personnel system remains to be detern 
either the NPRDC ner the thesis effectiveness ana 
presented kere are conclusive. Given the complexit 
is 


Seuune- ON or tne. trainina methodology os 


human behavior it is very diffi to evaluate whether 
their success is 

EEN y perceived attention EPICS sailors are getting asa 
Besult of the R&D nature cf the program. This is an impor- 
tant issue “that can te addressed only after more graduates 
complet2 EPICS and evaluations Or E her performance 
throughcut their careers are maintained. This presentation 


is simply a "snapshot" in time. Unfortunatelv, upon 
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completicn of R&D and implementation of rew programs useful 
data and analysis are often dismissed as unnecessary and 


time-consuming. 
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IV. CONCLUSIONS 

The EFICS evaluation and this thesis are but beginnings 
of an interesting and promising experiment. Should EPICS be 
Ege intc effect, it could possibly result in improved 
perscnnel planning, recruitment and retention during what 
may be a very crucial period for manpower acquisition within 
End external to the rilitary. 

Additional.output variables such as advancement exam raw 
scores, performance evaluation marks, 2tc., would provide a 
more substantial basis for comparing the ‘effectiveness! of 
EPICS vs. CFS 1148 FTMs. The data evaluatsd however, dces 
seem to indicate that entry scores on the ASVAB sub-ests MK, 
FI, GS and AR may not be the only subtests relevant to 
suitable personnel selection and training for a technical 
marang such as the fàire control technician. 

Should future data on EPICS sailor performance in the 
meet indicate comparable or Fetter proficiency relative to 
CPS trained sailors then Navy dscisionmekers may have a 
monce in terms of how much they are willing or able to 
Spend cn human capital training investments for skilled 


*eecanicians. 
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APPENDIX A 
EFFECTIVENESS ANALYSIS TABLES 


TABLE X 
Calibr8 Discriminant Analysis Summary 


5 
RY FCR CALIBRATION DATA: 
DZEDESOUARFD DISTANCE FUNCTION: 


-1 
Bex) = (X=7 )* Covo (X-X 
mon ( 2 ( Pu 


PesteniCh PROBAEILITIY OF MEMBERSHIP IN EACH CATEGORY: 


2 2 
PR(JIX) = EXP(-.5 E. Coe). 7 SUR EX p. D 


ES: AND PERCENTS CLASSIFIED INTO CATEGORY: 


ESOM 
CATEGORY 1 2 3 TOTAL 
1 381 28 15 424 
89.86 6.60 3:54 100.00 
2 1 2 1 - 
22200 3020) 2220937100500 
3 0 7 
14.29 0.00 sal 100700 
SCLaAL 383 30 22 435 
PERCENT 287.05 6.90 20055190200 


0m 33382023333 1073333 


(A 
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TABLE XI 
valid8 Discriminant Analysis Summary 


RIMINANT ANALYSIS 
e SUMMARY FOR VALIDATION TEST DATA: 


NERALIZED SQUARED DISTANCE FUNCTION: 


Hole) 
Runa 


IS 
LA 
WOR 
GE 
2 -1 
D (X) = (X-X)' CCV (X-X ) 
J J J 
PCSTFRIOR PROBAEILITY OF MEMBERSHIP IN EACH CATEGORY: 


2 2 
PR(J|X) = EXP(-.5 DEN) / ave EXP?(-.5 KOD 


ECF CES AND PERCENTS CLASSIFIED INTO CATEGORY: 


FROM 
CATEGORY 1 2 3 TOTAL 
1 174 13 17 204 
83229 Bear 92293 100200 
2 1 2 Q 3 
33.33 66.67 0.00 100.00 
3 1 0 3 4 
295900 0.00 75-00 100.00 
META L 176 15 20 2411 
PERCENT 83.41 Tavi S243 -100.00 
ERTORS 0233339 02393599 0.3333 
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| TABLE XII . 


Entry Paygrade 


| | 
| | 
i DUNCAN'S MULTIPLE RANGE TEST FOR VARIABLE: ENTRPAYG 
meee: THES TEST CCNTROLS ERROR RATES AT DIFFERENT | 
| LEVELS DEFENDING CN THE NUMBER OF MEANS BETWEEN | 
| BACH PT ATE BEING CCMPARED. ITS OPERATING | 
SHARNETERISTICS SCUBNHAT RESEMBLE FISHER'S 

| NERO TECTED LSD TEST. 
| ALPHA=0.05 DF=643 MSE=0.8€7748 | 
| HARMCNIC MEAN OF CELL SIZES=12.7465 
| OCEANS WITH THE SAME LETTER ARE NOT SIGNIFICANTLY | 
| DIFFERENT. | 
| DUNCAN GROUPING MEAN N CATEGORY | 

| 
| A 2.7143 E voz | 

| 
| B 1.8424 628 1 | 

| 
| C 1.0900 le 3 | 
| 
EM eR o tá 
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| TABLE XIII 

| Entry Age 

| DUNCAN'S MULTIPLE RANGE TEST FOR VARIABLE: ENTRYAGE 

| Memes THIS TEST CCNTROLS ERROR RATES AT DIFFERENT 
LEVELS EFING COMPARED. ITS OPERATING CHARACTERISTICS 

| SCUSAHAL REGEUBLE FESHER*S UNPROTECTED LSD TEST. 

| DEFENDING ON THE NUMBER OF MEANS BETWEEN EACH PAIR 

| ALEHA=0.05 DF=643 MSE=3.92129 

| HARMCNIC MEAN OF CELL SIZES=12.7465 

eee ANS @RITH THE SAME LETTER ARE NOT SIGNIFICANTLY 

| DIFFERENT. 

| DUNCAN GROUPING MEAN N CATEGORY 

| A 20.718 7 2 

| 5 19.091 p 3 

| B 18.944 628 1 


S7 
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TABLE XIV 
Number Days to E2 


DUNCAN'S MULTIPLE RANGE TEST POR VARIABLE: NDAYSE2 
RRECES THIS TEST CONTROLS ERROR RATES AT DIFFERENT 
LEVELS DEPENDING CN THE NUMBER OF MEANS BETWEEN 
EACH FAIR BEING CCMPARED.ITS OPERATING 
EHANNCTERISTICS SCMEWHATRESEMBLES FISHER'S 
INEROTECTED LSDETEST. 


ALEHA=0.05 DF=643 MSE=26870.3 
HARMCNIC MEAN OF EELL STAES=12. 7465 
MEANS SWIiTH SAME LETIER ARE NOT SIGNIFICANTLY DIFFERENT 


DUNCAN GROU PING MEAN N CATEGORY 
A 129636 LS 
E à 28,12 628 1 
E 0.00 JL 
eee ne sm 
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TABLE XV 


Number Days to EQ 


UA A es OS E A: A A A A A PE E e O AX ete ee A A a A a  l m 


DUNCAN'S MULTIPLE RANGE TEST FOR VARIABLE; NEWDAYU 
INS TEST CONTROLS ERROR RATES AT DIFFERENT 
LEVEIS DEPENDING CN THE NUMBER OF MEANS BETWEEN EACH 
Pon ENG COMPARED. ETS OPERATING CHARACTERISTICS 
SCMEWHAT RES EMBLE FISHER'S UNPROTECTED LSD TEST. 


ALEHA=0.05 DF=643 MSE=197293 
HARMCNIC MEAN OF CELL SIZES=12.7465 


MERNSEERSTH SAME LEITER ARE NOT SIGNIFICANTLY DIFFERENT 


DUNCAN GROUPING 


A 
A 
A 


tm to 
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MEAN 
665.57 
605.47 
286. 36 


N 

7 
628 
11 


CATEGORY 
2 
4 
3 


E 22 CUN ONEO AMENS OL Gm a O—--eSDDSBQOP SUIS. a ieee a C MESE a ae 
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TABLE XVI 
Tctal Number Denotions 


LTIPLE RANGE TEST FOR VARIABLE: TOTLDEMO 
ESE CCNIROLS SEROR RATES AT DIFFERENT 
ING CN THE NUMBER OF MEANS BETWEEN EACH 
MEARE Ueto OmeRATING CHARACTERISTICS 
NE DE Veoh om P ROT ECTED LSD TEST. 
ALPHA=0.05 DF=643 MSE=0. 230558 

HAFMCNIC MEAN OF CELL SIZES=12.7465 


IESANSEGWIDHOGSAMEODLEDBESR ARE NOT SIGNIFICANTLY DIFFERENT 


wog 


CUNCAN GROUPING MEAN N CATEGORY 
A 0.71429 VASES 
B 0.20382 629 23 
B 0.09091 11 3 


E 
| 
| 
| 
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TABLE XVII 
Attenticn to Detail 


AN'S MULTIPLE RANGE TEST FOR VARIABLE: ASVABAD 
Po TEST CCNTROLS ERROR RATOS AT DIFFERENT 

S DEPENDING CN THE NUMBER OF MEANS BETWEEN EACH 
EFFING COMPARED. 

FERATING CHARACTERISTICS SOMEWHAT 

EEE SHE ss “UNE ROLDECTED LSD TEST. 

ALPHA=0.05 DF=643 MSE=15.9587 

FARMCNIC MEAN OF CELL SIZES=12.7465 


MEANS MITH SAME LEITER ARE NOT SIGNIFICANTLY DIFFERENT 


ec EL u EEE u a AI) ill, «O: NS TI cl 


ni u ED en ae ae Fr u ar Sinto Mol | 


DUNCAN GROUPING MEAN Ni CATEGORY 
A 18. 8397 gam 
E A 18.000 i43 
E 19 1:95 628 1 
A A ES A a E SS o o meo im] 
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TABLE XVIII 


Spatial Perception 
DUNCAN'S MULTIPLE RANGE TEST FOR VARIABLE: ASVABSP 
IE THPIBNS VIRO RR SHTLAT UTE, 
PAIR EEING COMPAREL. ITS OPERATING CHARACTERISTICS 
SOMEWHAT PESEMBLE FISHER'S UNPROTECTED LSD TEST. 
ALPHA=0.05 DF=643 MSE=13.0164 
HARNMNCNIC MEAN OF CELL SIZES=12.7465 
MEIRNSEWITH SAME LEER ARE NOT SIGNIFICANTLY DIFFERENT 
DUNCAN GROUPING MEAN N CATEGORY 
A 7223093 11753 
E A 16.000 rS. 
E 14.524 623. 3 
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TABLE XIX 


Mathematical Knowledge 


EPENDING 
NG MPARED. 
ATI H 


NC 
TE 
VE D NDIN 
PRE EL COTE 
S ER NG C 
SHERTS UNPROT 


EO ro mi UN 


I 
O 
E 


DU 

NO 

LE 

PA 

Er 

Fl O 
A 


HARMCNIC MEAN OF CELL SIZES=12.7465 


MANS NT SAME CETITER ARE NOT SIGNIFICANTLY DIFFERENT 


DUNCAN GROUPING 


A 
A 
A 


UD UJ rr 
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MEAN 
16.000 
15.646 
13.364 


AN'S MULTIPLE RANGE TEST FOR VARIABLE: 


TIRIS TE L CENTROES ERROR RATES AT DIFFERENT 
CN THE NUMBER OF 


N 

7 
628 
11 


ASVABMK 


MEANS BETWEEN EACH 


AHACTERISTICS SOMEWHAT RESEMBLE 
ECTEDOLCSDATEST 


LPHA=0.05 DF=643 MSE=9. 1634 


CATEGORY 
2 
1 
3 
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DUNCAN GROUPING MEAN N CATEGORY 
à 24.143 o 
E A 23.568 628 1 
| E 20.818 ¡EE 
IE TE E IA e 


TABLE XX 
Electronic Information 


DUNCAN'S MULTIPLE RANGE TEST FOR VARIABLE: ASVABEI 
OTe: tudo TEST CCNTROLS ERROR RATES AT DIFFERENT 
LEVELS DEPENDING CN THE NUMBER OF MEANS BETWEEN EACH 
PAIR EEING COMPARED. ITS OPERATING CHARACTERISTICS 
SONENHAT RE SEMBLE FESHER*S UNPROTECTED LSD TEST. 
AIPHA=0.05 DF=643 MSE=16.0351 
HARMCNIC MEAN OF CELL SIZES=12.7465 


Mearns WITH SAME LETTER ARE NOT SIGNIFICANTLY DIFFERENT 
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TABLE XXI 
General Science 


| 
| 
NCAN'S MULTIPLE RANGE TEST FOR VARIABLE: ASVABGS 
IEA TS TEST CONTROLS ERROR RATES AT DIFFERENT | 
VELS DEPENDING CN THE NUMBER OF MEANS BETWEEN EACH | 
IR PEINGOTCONPARED: IIS OPERATING CHARACTERISTICS | 
MEWHAT RESEMBLE FISHER'S UNPROTECTED LSD TEST. | 
AIPHA=0.05 DF=643 MSE=7. 80593 | 
HARMCNIC MEAN OF CELL SIZES=12.7465 | 

| 

| 

| 


MEANS WITH SAME LETTER ARE NOT SIGNIFICANTLY DIFFERENT 


DU 
NO 
LE 
PA 
SC 


AS is A ci, euer up O at MR | 


DUNCAN GROUPING MEAN NAC AD EGOR Y 
A 16.429 T 4 
B A 14.702 628 1 | 
E uo T2 11 3 | 
a e J 
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TABLE XXII 
Entry Faygrade LSMEANS Analysis 


| 

| | 

| | 

| 

| | 

| | 

CAT ENTREAYG STD ERR PROB > IT| LSMEAN | 

| LSMEAN LSMEAN HO:LSMEAN=0 NUMBER | 

| I 084235669 90375 9802 0. 0001 1 | 

2 2 UN HE 1 0.3561 19514 0.0001 2 | 

| 3 1.00€00000 0.28408511 0.0005 3 | 

| ERCE > IT HO: LSMEAN (1) =LSMEAN (3) | 

| I/J 1 2 3 | 

| 1 . 0.0152 0.0034 { 
| 2 OOS 2 . -0002 

| 3 0.0934 0.0002 . 


] 
| 
| 
| 
| 
| 
| 
| 
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TABLE XXIII 
Entry Age LSMEAN Analysis 
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TABLE XXIV 
Number Days to E2 LSMEAN Analysis 
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TA BLE 
Total Demotions LSMEAN Analysis 
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LSMEAN (I) =LSMEAN (J) 
0.0074 
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TABLE 
Attention to Detail LSMEAN Analysis 
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XXVIII 
Spatial Perception LSMEAN Analysis 
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TABLE XXIX 
Mathematical Knowledge LSMEAN Analysis 
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TABLE XXX 
Electronics Information LSMEAN Analysis 
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TABLE XXXII 
Multivariate Analysis of Variance 


MANOVA TEST CRITERIA FOR THE HYPOTHESIS 
OF NO CVERALL CATEGORY EFFECT 

H = TYPE IV SS&CE MATRIX FOR: CATEGORY 
E = ERROR SSECP MATRIX 

E = DEP. VARIABLES = 22 

O = HYPOTHESIS DF = 2 

ÑE= DE CF E = 643 

S = HIN (PO) - 2 

M = 2 (RES | -Q) -1) = 9.5 

N = .5(NE-P-1) - 310.0 


an Ee qb Ea ab ab A SEP eae eee XP GNE EDO Gu eee A A mi me ee P n p SO Am A ce Ue Ur Ue Ur Ue ee eee See A eee eee Se eee ee eee Pee Se ee 


HOTELLING-LAWILEY TRACE = TR(E**-1*H) = 0.20735938 
F APPROXIMATION = 2(S*N+ 1) DES ouese at’ Ann 2lsaneın B 
WITH P 


(24+5+1) AND 2(S*N+1) 
F(44,1242) = 2.93 PROB > F = 0.0001 
FILLAI'S TRACE V = TR(H*INV(H+E)) = 0. 18616448 


F APPROXIMATION = (2N+S+ 1) /(2M+S+1) * V/{S-V 
WITH S(2M+S+1) AND S(2N+S+1) D 


F(44,1246) = zu PROB > F = 0.0001 
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